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ABSTBACI 

The Munby systea for coding classroon interaction is 
an observation systen constructed to study the intellectual 
consequences of varying kinds of science teaching behaviors. The 
initial use of the system called 'for Baking judgsents about sisall 
portions of teaching^ arbitrarily^ deterained froa a transcript of the 
teaching in question. Recent vorK vith the systea to deternine its 
validity resulted in a change in the scoring technique to perait 
coding a lesson directly or froa a recording. The purpose of this 
aanual is to describe this nev coding procedure in detail. General 
directions for using the scoring sheet are given first. These are 
followed by detailed descriptions of hov the classifications are to 
be interpreted for the Instrumentalist-Realist diaensicn. This is 
followed by a brief guide to the use of the Intellectual Independence 
and Intellectual Dependence dimension. An annotated bibliography is 
provided which includes references to the Munby Systea and to works 
which are related to this approach. The Hunby System itself is 
appended. (Author/MA) 
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\ Introduction 

The M^nby System for oCoding classroom interaction is 
described in\ Mirrors for Behavior III: An. Anthology of 
Observation iL^struments , edited by Anita Simon and E. Gil Boyer. 
This observation systen^ was constructed to study the intellectual 
consequences ofv varying , kinds of science teaching behaviors / and 
it consists of two dimensions. One assesses the view of science ^ 
which the teacher\ teaches^ either "realism, " .where the teacher 
talks abd^t "scieritific entities" (like ions, charges, genes) 
"as if" they were real, as contrasted with " instrumentalism" 
which talks about scientific concepts "as if" they were models 
which may be more orXless useful than other models to describe 
the^ world. Vhe Second^^ dimension assesses the ^teacher • s provision 
for the intellectual independence or dependence of the student. 
The student is^ said to be intellectually independent when he has 
all the resources necessary for judging the truth of a knowledge 
claim independe\itly of other people, and, in contrast, the' 
student is said' to be dependent when he must rely on someone 
else's authority. 

The initial, use of the system'^ called for making judgments 
about small porti6ns or "episo^des" of teaching, rather arbitrarily 
determined from a transcript of ^ the teaching in question. Recent 
work with the system. to determine its validity resulted in a 
change in the scoring technique, \principally to permit one to 
code a lesson directly or from a recording. The purpose of this 
manual is to describe this new coding procedure in detail. The 
description opens with general directions for using *.he scoring 
sheet. ^ These are followed by detailed descriptions of how the 
classifications are to be interpreted, for the Instrumentalist- 
Realist dimension. This is followed l?y a brief guide to the use 
of the Intellectual Independence and Intellectual Dependence 
-^dimen3ion. An annotated bibliography is provided which includes 
references to the Munby System and to works which are related to 
this approach. The Munby System itself is appended. 

Genera X Directions ' ' ' 

^ \ 

The general directions for scoring a lesson using the 
Munby System assume that a coder can assess classroom, interaction 
at thirty- second intervals, and that for the Instrumentalist- 
Realist dimension of the system, he' can judge a thirty-second 
portion of teaching as belonging to one of the following five 
categories: 

very instrumentalist 
somewhat instrumentalist 
intermediate; irrelevant or managerial 
somewhat realist 



very realist. 




These categories are described in detai? later in this document. 
It will be seen that the categories appear on the Munby System 
Scoring Sheet (on the following pag'te) . This sheet IS used as 
follows. 

1. The information required to identify the lesson being, scored 
is entered at the top of the sheet. An assigned number is 
used for identifying the teacher when the instrument is used 
for research in which anonymity is important. "Class" should 
reflect the grade and subject (e.g. Grade 10 Science. "Lesson" 
is for a brief description to identify the lesson (e.g. Intro- 
ductory Electrostatics) . 

2. Each scoring sheet can accept 15 minutes of scoring. As each 
sheet is started, the appropriate box under "Minutes" is 
chec*ked so'that the sheets for a total lesson are kept in, A 
proper order . 

3. The lesson is scored by making a single "X" at each half 
minute interval in the appropriate category. The space for 
comments to the left of the columns permits the scorer to - 
make qualitative notes, if he wishes, of specific features 
of the thirty seconds of dialogue which led him to score as 
he did. (This practice is especially useful for training 
scorers when some record is needed for comparing the work of 
two or more coders. It is also useful for noting the words 
used by the teacher at the points when scoring starts and • 
stops, so that other observation schemes used in the same 
lesson can be made to synchronize.) 

4. The total score for a coded lesson is found after determining 
the "I" (Instrumentalist) and "R" (Realist) score on each 
page of the scoring sheets used. The pages are completed by 
finding the total of "X" marks in each category. Since I2 is 
defined, as described later, as very instrumentalist, it nas 
a value of 2 x I. A check mark or "X" in category "0" i.^i 
half of I. and half of R. Thus "This page I" is computed 
from 2 X I2 — 1 x I, — ^ x 0. "This page R" is determined 
similarly. Enter "Tnis page"' I and R scores in the appropriate 
places in the boxes at rhe lower right hand side of the Scoring 
Sheet. Enter also the previous cumulative, if appropriate, 
and derive the cumulative for the page in question. These 
cumulative scores are transferred to the following scoring 
sheet. 

5. Each sheet is treated similarly and in order, so that the 
final page for a coded lesson has cumulative I and R scores 
for the whole lesson. „ 

6. The overall score 'for the coded lesson is found by adding 
the final cumulative I and R scores to determine the total 
number of points awarded in the lesson. The fraction of 
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MUNBY SYSTEM SCORING SHEET 
(View of Science Dimension) 



Ti.A' fi. 5 NO. V ^ DATi: 



CLASJ 



SUBJEJCT 



♦ - 



ERIC 



TOTALS 





^ 2 


-I 


! r) 


D 

^1 




TIME 










/ 


- y 

/ 












/ 




1 


- 












lb 














2 












1 


2H 












1 3 














2h 






j 






1 


4 












44 














5 




















i . ' 








i 6 
















• 












7 














7H 














■ 8 




























9 


* 












9 b 














10 














■10b 














11 


0 












lib 






\ 








12 














12b 














13 














13k 














14 














14b 














15 



SCORER 
MINUTES + Q 0 

□ 30 

□ 40 

1 : 2 X 

1 X 



This, page "I 



R: 



b X 

1 X 

2 X 



This paqo K 




MUNfeY gYSTEM SCO^G SHEET 
(Intellectuil Independence Dimension) 



•i l.A< I. 




SCORER 
.—^ MINUTKS + Q]- 0 



TOTALS 



ERIC 



II: 2 X ■ 

1 X j 

h X _; 

This page-; II 



ID 



1 ^' 

9 \ 



This pa^e ID- 



II 
ID 



i 



- 5 



these points that aie -'R", converted to a percentage is the 

overall lesson score on the Realist dimension: \ 



ERIC 



Or, REALIST SCORE: * R^ x 100% 

; ' I I- 

^ t --)- t: 

Where R^ and are the final cumulative or total R and I scores 

t t 
for the legson . 

Description of the Categories 

Lessons are coded with the Munby System by attending to the 
presence of "cues" which are listed beneath each dimension of 
the System itself (as given in the appendix) and by judging 
each half minute of interaction as l^i Ij;,/ 0 , Rn and R2/ as 
noted above. These categories are described below to enable ^ 
scorers to use the systam accurately. 

- Very Instrumentalist - ^ 

Statements that fall into the I 2 category may be of two 
types. The easier type' to detect is an overt statement about 
the nature of scientific reality, or about scientific models 
or "objects" which is in keeping with the instrumentalist 
position. Statements which make it clear that science is one 
of several competing explanatory modes, statements which 
specifically delimit the explanatory power of science, statements, 
which specifically note the ontological differences between 
scientific and common-sense objects of perception are all statements 
of this type. They are global iii scope, and distinctly instrument- 
alist in mature. . 

j> » 

Tne s.econd type within this category is closer to I^ and hende 
slightly harder to distinguish. It contains .statements about the 
nature of models, theories and the like, but in reference to a 
model which is being developed. Statements such as "If this m<>^el 
is any good ...", "We can check the correspondence between our 
model and ..." and "We will^have to discard this model if it proves 
inadequate" are examples of this type. They deal with^the model ^ 
as a whole rather than with models ia general. It is not essential 
to be able to distinguish between the two types for scoring purposes 
except that being able to internalize the entire scale with its 
extremes as accurately as •'possible yill probably lead to finer 
scoring discriminations. 

Etymology may be used in such a way that it would score I^ 
^s well. If the explanation is specifically congruent with the 
notion that a theory is man-made rather than an inevitable happening, 
and"th)at the language supports this point, then the scoring is I^. 
For example, "The word electric was used simply because it was a 
Greek name for a group of substances all of which showed some 
peculiar, but unexplained property . . . falls into this class. If 
is significant that to merely Classify or name something does not 
exolain it. 

■ 7 
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S^ore statements by placina "X" in the 1^ column of the 
Munby System Scoring Sheet. . *a 

-Somewhat Instrumentalist 

Whereas I^ statements could be judged "cold", more contextual 
information is needed for the I, category. For example, consider 
the etymological'' example of the last section; If the emphasis 
that a theory is a man-made entity is not clear, but the explan- 
ation is within an instrumentalist context (see the following) 
then the score would be I. rather than l^* Simple definitions 
of a word-explaining nature within an instrumentalist context 
would likewise be scoired I^. ^ 

While I^ statements dealt with general characteristics, I. 
statement's aeal with specific model 'or theory development. If 
a specific model is "being developed, and the previous body of 
the l,esson has been established as being instrumentalist by the 
presence of I^ statements, then statements about the requirements 
of the model Being developed will be I^. It is understood by 
context that if the model-building activity is not successful, / 
then the model can beMiscarded, Hence the context is necessar^ 
to ensure that we are scoring on the proper side of the-' 0,. or 
midway point, of the scale. Exercises in model building, the 
performing of demonstrations, listing of correspondences between 
model and the observed, would all fall into this category^ The- 
context is necessary to distinguish and 0 categorizations. 
If. there is no specific context, then experiments and demonstra- 
tions wouid fall into class 0 rather than 1^^. Similarly, if 
natural history is being used in an instrumSntalist context, it 
would score as I^. (It could also score as 0 or as discussed 
below ^) 

In class discussion, distinctions made between theoretical 
statements and "observations would be I, statements. Interaction 
whi-ch is obviously "setting up" for a discussion of the nature of 
explanation or the distinctions between data and "concepts would 
also score I,. This is a , kind of before-the-fact context 
establishing, but can be identified by a trained observer. It is 
helpful to compare the preparation (I^) to the making of the 
statement (I2)' 

Statements regarding the implications of a theory, either 
suggested or tested, would score as ly 

A typical instrumentalist oriented lesson might begin with 
an I^ level discussion about the nature of models, follow with 
an I^ level section of , model-building , and conclude with an 0 
level section of lab work or homework. ^ ^ 

Score I^ statements by placing "X" in tne I^ column of the 
Munljy System Scoring Sheet. 



8 



1 



ERIC 



- 7 - ^ 

0 - Intermediate ^ 

This category, marked with an X is for interaction which might 
be judged 'R-or I. (It is not to be confused with "Irrelevant or 
Managerial - - see below.) . 

As ment^ioned in the J, discussion, the context is important 
^fbr distinguishing between «I^ and 0 judgments. ,It is .also 
ifOportant for and 0 level discriminations. 

Statements which have to do* with the lesson content, Sut y 
which show neither realist nor instrumentalist overtones wCuld^ 
be classed here. Scoring should be made with the . same mark^ 
"X", as is used in the\pther four , columns ' to^ indioate thar it 
will be included in the final score calculation. Descriptive 
statements about equipment or materials woul'd lie' in this 
category. When a ^iece of equipment is being descrilDed,: or its 
parts enumerated/ or displayed, a score would be made in the 0 
column. If the context 'of a given ^Section of discourse is either 
neutral or indeterminate, then the statement belongs hejre. 

Sometimes the scorer \;ill be unsure about the position of 
-a given tijme interval. This may be because (a) the context has 
not yet b^en established, or (b) the scorer .had difficulty placing 
the conte>ct. The 'first type properly belongs in the 0 ^olumn. 
It- is found that as one's scoring bBComes more critical, ^there 
will be fewer instances of the^secorid kind, and that more statements 
will be classed as It or %^ than initially was the case. 

1 ^1 — — 

* Sometimes science lessons are actually natural Jiistory lessons. 
That is, they are not explaining anything but rather are setting 
forth straight history, ot descriptions of phenomena. Such lessons, 
or portions thereof, wou-lcj be scored here ^s intermediate. 

A problem that exists is the temporal duration that should be 
'Considered for context establishment. For 1^ and ^^^f of course, 
coiH;ext is not a problem. But the three categories l-j^, 0,^and 
als^ depend upon knowledge of context for accurate judgment. 
If the\ contextual time span is increased, then the number of 
statements classified as R, or I^ will increase at the Expense 
of tlje n\imber of level ). It is believed that the context- 
establisliing time span should be fairly lon<gL, such that scored 
level 0 statements are only descriptive on.es ifi possible. The ^ 
effect of this will be to make the scores slpmewhat^ more extreme. 
In other words, overall score variance is amplified as a consequence 
of increased- discrimination between I an4 R.- 

V 

Score intermediate statemerfts by placing ^JX" in the 0 column 
of the Munby System Scoring Sheet. 

0 - Irrelevant or managerial _ 

* ' 

For anything descrj|.beA in this part,,'- marjc "-"\in the 0 level ^ 
column so tha'jt such tallies will not b£* included in the final 
calculation* Cit -is worth./hile to have these scor.es indicated" 



• 9 



- 8 - 



*^eveh though they wilx not Sffect the data because 'they erjsure 
' that the time flow of the lesson is not inter rup-ted*^ Thvis it 
is easier to locate a given section of the lesson .if' this 
becomes necessary.) - ' , i 

Managerial: 

Managerial items include attendance taking, general Office 
announcements, class announcements, homework checking (to ^ee 
if it is completed, not taking up) and 'the like. \ ^ ' 

Time slots which are unscorable because of excessive noise, 
recording prol^lems, fire a'larms, searches for chemicals or 
materials, assembling of equipment without scorable commentary, 
prolonged blackboard writing without sbor.able commentary and the 
like will also be scored 

Two problems cap arise in using this category. First, when 
should scoring begin? It is possible either to start scoring 
immediately when the teacher enters the room (using the number 
of marks required) or to wait until some signal is given 
, that the lesson is about to begin/ (and then use the number 

marks required.) The letter approach is favored; although 
the difference will probably not be significaat. 

Second, periods of noise or other *unscor,^ble periods do 
not usuai-ly confine themselves neatly to a scoring period^ of 
thirty seconds. if an unscorable time occurs which is about 
25 seconds .in length than the time should be scored ;and 
the balance of that intet^al sliould be included with- the r ' , 
succeeding iriterval to be scored. * Similar sra^ll temj^oi^al ^ . 
irregularities may be encountered in other' situations . fThe 
goal of the observer should be .to score as accurately a^' 
possible everyi half minute without reducing the validit]/ of 
his res^ults. |lf it Is^-^felt that a shift of a few seconds will 
r:esult in a more valid score, ^ then this should be done , f be^lring 
in mind^hat the increasing discrimination results in amplifying 
the variance. < , _ ^ * ' W 

Score Irrelevant or Managerial Statements by placing 
' in the 0 column of the Munby System Scoring Sheet. ^ 
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R-| " Somewhat Realist , 

; If a statement^ is not necessarily realist all on its own,, 
but is within a realist context then this is where it belongs. 
For example,' definitions^ supplied within a realist context would' 
score as R-. , whereas definitions supplied in a neutral context, • 
or simply for operational convenience (generally with a note that 
the meaning will be pursued in more detail later) would scbre 0. 



Situations wherein realist premises are worked from would 
score r:, • Hence theory-building in' the didactit: sense of ♦ "here 
is how it works" scores here, as would statements in biology about 
how things function. Typically these sorts of statements ariose 
wher the difference between' corr(elations and explanations is not 
mAde clear. "Newton's second law tells us that is stated 

10 ^ 
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in explanatory . form, leading one to believe that matter is 
forced to conforrfi to particular scientific principles.. This c 
implied immutability of scientific truth expresses a realist 
position. Similarly,, spealcing of seeing properties, that one 
cannot see a^ though they 'were olD^ervable phonomena is a realist 
set. For example, "We can see chat lead has a gi^eater -affinity , 
for oxygen than has raerpury'* states an idea in Q^>servational 
form. 

« . 7 / . ■ 

Natural history can also score here if the perspective' iS 
one of presenting older or discarded theories as being inaccurate 
or wrong accounts <5f reality. It will be observed that natural 
history now appears in three categories in this scheme., All of 
them are context dependent. ^ ^ . ^ 

Finally", is the correct scorer' when conr ^pts- or symbols 
are introduced for the sake of organizational convenience, even 
though they are signif icaji-t concepts or 'symbols, their significance 
is not 'mentioned ,• or at least 'the fact that tfiiey are significant 
is not mentioned. For ejcample, -suddenly int.'^oducing words such 
as "force, energy, power" as pairt'of an explanation of Something 
else when the students would not be familiag with the precise* 
meaning that the teacher applies to these words^rojnotes a 
realist understanding. Similarly; an unexplained *introdi^ction of 
coefficients and subs^cripts into chemical equations would require 
scoring. . ^ , 

Score statements by placing "X" in the R^ column of the 
* ^ Munby System Scoring Sheet. 

R^ - Very Realist ' 
1 ^ , 

/ 

The basic crit^ion for statements of this category is that 
they can be scored' as being realist without regard to context. 
Statements such as; "it takes ^the electrons from ... and puts 
them . . . and holds on to .." assiftne very clearly the physical 
reality of what the instrumentalists cla^s ,as postulated entities. 
This if found to be the most common statement type in this 
category. Overt statements of the ^ollowing^types would also 
score here.: -^That old theory is v(rong, but the new one is right", 
"Science is really the only viable way ta explain this", and ' 
"Anything can be explained scientifically if enough data can be 
collected". 

Unexplained anthfopoiuuiphisms also score here. To say that 
el\§ctrons "like" to occupy certain orbits, orbitals, or regions 
of space because the energy requirements are lower, or that 
electrons "don't" like" to be paired up is to make a statement of 
this type. (To s"ay ''^'it/is handy to think 'of ... as showing 
electron greediness" is not a statement of this type because^, the 
use of a convention has been- signalled, 'which is instrumentalist.) 

Categorization into the R2 group is esseitial]y based upon 
the degree of covertnes^. When the statement is obviously r^^alist, 

' 11 , . ■ 
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.;and can be understood as such ir>' virtually any context, then 

is the appropriate score* The difference between this 
category and R. is parallel to the differences betv/een and 




Score Rp statements by marking "X" in the R2 column of the 
Munby System Scoring Shfeet. 

Am 

The Intellectual Independence Dimension 

The second dimension of the Munby System permits one to 
score a lesson for the provision ,it 'makes for Intellectual 
Independence or Intellectual Dependence* A lesson can be 
scored on this dimensir^n by using the Munby System Scoring 
Sheet designed for this purpose. " ^ 

-v 

Scoring, and computing p^oc ^ed as before/ the scorer relying 
upon the cues provided in the Munby System for this dimension. 
Using guidelines similar ±0 tho-^e describing the differences 
between Very Irtstxumentali^t and Somewhat Instrumentalist, the 
scorer can discriminate between Very Intellectual Independence 
and Somev^hat Intellectual Independence, and between Very 
Intellectual dependence and Somewhat Intellectual Dependence. 

c Notice to Users - 

The Munby System and related materials is protected by 
the Canadian Copyright Act. Permission to use the Munby Syster^ 
must be obtained from the 'author. Permission will be granted 
•normally on tHe understanding that any publication referring to 
the Munby System, depending on its use, will acknowledge this 
with proper citations,, and that ^research results from using the 
Munby System^ or critical commentary on the system will be 
communicated to the author. 
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MUNBY SYSTEM 
Dimension 1: View Of Science Provided For 
R - .REALIST: 

a. Theories are stated as if they have the same logical 
status as observation statements. 

b. '" "Scientific obje^cts" (postulated entities) are talked 

about as if they have the same ontol9gical status as 
comh\on-sense objects ot perception. They have a physical 
reali'ty. % / 

c. Science presented, as the only acceptable way of describing 
or explaining the world or phenomena. 

d. Science spoken of as superior to alternative explanatory 
' modes . 

e. 'Past theories are -presented as false. 

f. Lapsed '•scientific objects" given as inaccurate accounts 
of reality. ^ 

g. ..The potential of science for explaining or describing is 

given as unlimited. 

h. That a model, law, theory, or convention is being used is 
not signalled to pupils. 

i. A*' model; law, theory, or convention is invoked as 
description of phenomena. 



ERLC 



I - INSTRUMENTALIST;- 

a. Theoretical and explanatory statements are stated as if 
they have a logical ;status different from that of 
observation^ statements. 

b. "Scientific objects" presented as having a different 
ontological status from common-sense objects of perception, 
They are postulated entities. 

c. Science presented as one way Qf explaining the world or 
phenomena. 

d. Science spok'en of as in competition with alternative ^ 
explane^tory modes. 

e. Past theories presented as ^inadequate. 

f. Lapsed "scientific objects" given as inadequate explan- 
" atory devices. 

The potential of" "science for explaining and describ^Lng 

is given as limited. ' ^ - 

That a model, law, theory, or convention , is being used 

is signalled to pupils. * * • ^ 

i. A models law, .theory/ or convention is invoked as an 
explanation 'of phenomena. 

15 • 
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MUNBY "SYSTEM (continued) 
Dimension 2t Provision For intellectual Independe nce Or Dependence 

II - INTELLECTUAL INDEPENDENCE: 

a. Evidence is ^provided in support of claims. 

b. The argument is present. 

,c. Corresponde 'ce of diagram or^it^odel to phenomena is 
demonstrated by argument and evldenre. 

d. Adequate reasons given for the acceptability or 
unacceptability of a pupil's statement or response. 

e. Suggestions, questions,, and objections of pupils- are 
. honored and aro treated with rega^'d to reason. 

f. Pupils have" provision to make judgments of the 
viability of models, theories, and explanations by' 
recourse to phenomena. , .v 

g. Alternative models, theories, and explanations are 
provided to permit pupils to make judgments among them. 

h. Discrepancies among observations or evidence are 
rationally resolved. - 

ID - INTELLECTUAL DEPENDENCE: , 

a. Evidence is not provided in support of clai^iDs.' 

b. The argument is absent. . t ^ v 
.i.e. Correspondence of diagram or model to phenomena is not 

demonstrated by evidence or by argument. 

d. Adequate reasons for the acceptability or unacceptability 
' of a, pupil's response are absenrtl ^ 

e. Suggestions, questions, and objections of pupils are not 
honored or are not treated with regard to reaso^i, 

f . Provisioiv.is not made for pupils -to make judgments of the 
viability of models, theories, and explanations by 
recourse to phenomena. 

g. The making of judgments among alternative models, theories, 
and explanations is preempted since alternatives are not 
provided. v ' - ' 

* ' h. DiscrepancieiJ^*-.££mong .observations or evidence are not- 
^ resolved on rfjVional groi^nds. 



From A'. Hugh Munby, "."The Pr\visiori Made "for Selected Intellectual 
Consequences by Science Teac^hing: Derivation and Application of 
an .Analytical Scheme." Urrpti^ished Ph.D. dissertation, Universi-:y 
of Toronto, 1973. © Copyrighted. ' 



